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DUPLICATE 

Voice Communication Concerning a Local Entity 
Field of the Invention 

5 The present invention relates to voice services and in particular, but not exclusively, to a 
method of providing for voice interaction with a local dumb device. 

Background of the Invention 

In recent years there has been an explosion in the number of services available over the 
10 World Wide Web on the public internet (generally referred to as the ' Veb"), the web being 
composed of a myriad of pages linked together by hyperlinks and deUvered by servers on 
request using the HTTP protocol. Each page comprises content marked up with tags to 
enable the receiving application (typically a GUI browser) to render the page content in the 
manner intended by the page author; the markup language used for standard web pages is 
1 5 HTML (HyperText Markup Language). 

However, today far more people have access to a telephone than have access to a computer 
with an Intemet connection. Sales of cellphones are outstripping PC sales so that many 
people have already or soon will have a phone within reach where ever they go. As a 
20 result, there is increasing interest in being able to access web-based services from phones. 
* Voice Browsers' offer the promise of allowing everyone to access web-based services 
from any phone, making it practical to access the Web any time and any where, whether at 
home, on the move, or at work. 

25 Voice browsers allow people to access the Web using speech synthesis, pre-recorded 
audio, and speech recognition. Figure 1 of the accompanying drawings illustrates the 
general role played by a voice browser. As can be seen, a voice browser is interposed 
between a user 2 and a voice page server 4. This server 4 holds voice service pages (text 
pages) that are marked-up with tags of a voice-related markup language (or languages). 

30 When a page is requested by the user 2, it is interpreted at a top level (dialog level) by a 
dialog manager 7 of the voice browser 3 and output intended for the user is passed in text 
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form to a Text-To-Speech (TTS) converter 6 which provides appropriate voice output to 
the user. User voice input is converted to text by speech recognition module 5 of the voice 
browser 3 and the dialog manager 7 determines what action is to be taken according to the 
received input and the directions in the original page. The voice input / output interface 
5 can be supplemented by keypads and small displays. 



In general terms, therefore, a voice browser can be considered as a largely software device 
which interprets a voice markup language and generate a dialog with voice output, and 
possibly other output modalities, and / or voice input, and possibly other modalities (this 
10 definition derives from a working draft, dated September 2000, of the Voice browser 
Working Group of the World Wide Web Consortiimi). 

Voice browsers may also be used together with graphical displays, keyboards, and pointing 
devices (e.g. a mouse) in order to produce a rich "multimodal voice browser". Voice 
1 5 interfaces and the keyboard, pointing device and display maybe used as alternate interfaces 
to the same service or could be seen as being used together to give a rich interface using all 
these modes combined. 

Some examples of devices that allow multimodal interactions could be multimedia PC, or 
20 a conmiunication appUance incorporating a display, keyboard, microphone and 
speaker/headset, an in car Voice Browser might have display and speech interfaces that 
could work together, or a Kiosk. 

Some services may use all the modes together to provide an enhanced user experience, for 
25 example, a user could touch a street map displayed on a touch sensitive display and say 
"Tell me how I get here?". Some services might offer alternate interfaces allowing the user 
flexibility when doing different activities. For example while driving speech could be used 
to access services, but a passenger might used the keyboard. 
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Figure 2 of the accompanying drawings shows in greater detail the components of an 
example voice browser for handling voice pages 15 marked up with tags related to four 
different voice markup languages, namely: 

- tags of a dialog markup language that serves to specify voice dialog behaviour; 
5 - tags of a multimodal markup language that extends the dialog markup language 

to support other input modes (keyboard, mouse, etc.) and output modes (large 
and small screens); 

- tags of a speech grammar markup language that serve to specify the grammar of 
user input; and 

10 - tags of a speech synthesis markup language that serve to specify voice 

characteristics, types of sentences, word emphasis, etc. 

When a page 15 is loaded into the voice browser, dialog manager 7 determines from the 
dialog tags and multimodal tags what actions are to be taken (the dialog manager being 

1 5 programmed to tmderstand both the dialog and multimodal languages 1 9). These actions 
may include auxiliary functions 18 (available at any time during page processing) 
accessible through APIs and including such things as database lookups, user identity and 
validation, telephone call control etc. When speech output to the user is called for, the 
semantics of the output is passed, with any associated speech synthesis tags, to output 

20 channel 12 where a language generator 23 produces the final text to be rendered into 
speech by text-to-speech converter 6 and output to speaker 1 7. In the simplest case, the text 
to be rendered into speech is fully specified in the voice page 15 and the language 
generator 23 is not required for generating the final output text; however, in more complex 
cases, only semantic elements are passed, embedded in tags of a natural language 

25 semantics markup language (not depicted in Figure 2) that is understood by the language 
generator. The TTS converter 6 takes account of the speech synthesis tags when effecting 
text to speech conversion for which purpose it is cognisant of the speech synthesis markup 
language 25. 

30 User voice input is received by microphone 16 and supplied to an input channel of the 
voice browser. Speech recogniser 5 generates text which is fed to a language understanding 



module 21 to produce semantics of the input for passing to the dialog manager /. me 
speech recogniser 5 and language understanding module 21 work according to specific 
lexicon and grammar markup language 22 and, of course, take account of any grammar 
tags related to the current input that appear in page 1 5 . The semantic output to the dialog 
5 manager 7 may simply be a permitted input word or may be more complex and include 

= embfldded tags of a natur a l l an gt i^g e s < ? m an tic s m arkup 1a ,p guageJ:he_dialog manager 7 

determines what action to take next (including, for example, fetching another page) based 
on the received user input and the dialog tags in the current page 15. 

10 Any multimodal tags in the voice page 15 are used to control and interpret multimodal 
input/output. Such input/output is enabled by an appropriate recogniser 27 in the input 
channel 11 and an appropriate output constructor 28 in the output channel 12. 

Whatever its precise form, the voice browser can be located at any point between the user 
1 5 and the voice page server. Figures 3 to 5 illustrate three possibilities in the case where the 
voice browser functionality is kept all together; many other possibilities exist when the 
functional components of the voice browser are separated and located in different 
logical/physical locations. 

20 In Figure 3, the voice browser 3 is depicted as incorporated into an end-user system 8 (such 
as a PC or mobile entity) associated with user 2. In this case, the voice page server 4 is 
connected to the voice browser 3 by any suitable data-capable bearer service extending 
across one or more networks 9 that serve to provide connectivity between server 4 and end- 
user system 8. The data-capable bearer service is only required to carry text-based pages 

25 and therefore does not require a high bandwidth. 

Figure 4 shows the voice browser 3 as co-located with the voice page server 4. In this case, 
voice input/output is passed across a voice network 9 between the end-user system 8 and 
the voice browser 3 at the voice page server site. The fact that the voice service is 
30 embodied as voice pages interpreted by a voice browser is not apparent to the user or 




network and the service could be implemented in other ways without the user or network 
being aware. 

In Figure 5, the voice browser 3 is located in the network infrastructure between the end- 
5 user system 8 and the voice page server 4, voice input and output passing between the end- 
user system and voice browser over one network leg, and voice-page text data passing 
between the voice page server 4 and voice browser 3 over another network leg. This 
arrangement has certain advantages; in particular, by locating expensive resources (speech 
recognition, TTS converter) in the network, they can be used for many different users with 
10 user profiles being used to customise the voice-browser service provided to each user. 

A more specific and detailed example will now be given to illustrate how voice browser 
functionality can be differently located between the user and server. More particularly. 
Figure 6 illustrates the provision of voice services to a mobile entity 40 which can 

15 commimicate over a mobile commimication infirastructure with voice-based service 
systems 4, 6 1 . In this example, the mobile entity 40 communicates, using radio subsystem 
42 and a phone subsystem 43, with the fixed infirastructure of a GSM PLMN (PubUc Land 
Mobile Network) 30 to provide basic voice telephony services. In addition, the mobile 
entity 40 includes a data-handling subsystem 45 interworking, via data interface 44, with 

20 the radio subsystem 42 for the transmission and reception of data over a data-capable 
bearer service provided by the PLMN; the data-capable bearer service enables the mobile 
entity 40 to access the public Intemet 60 (or other data network). The data handling 
subsystem 45 supports an operating environment 46 in which applications run, the 
operating environment including an appropriate conmaunications stack. 

25 

Considering the Figure 6 arrangement in more detail, the fixed infirastructure 30 of the 
GSM PLMN comprises one or more Base Station Subsystems (BSS) 31 and a Network 
and Switching Subsystem NSS 32. Each BSS 31 comprises a Base Station Controller 
(BSC) 34 controlling multiple Base Transceiver Stations (BTS) 33 each associated with a 
30 respective "cell" of the radio network. When active, the radio subsystem 42 of the mobile 
entity 20 communicates via a radio link with the BTS 33 of the cell in which the mobile 
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entity is currently located. As regards the NSS 32, this comprises one or more Mobile 
Switching Centers (MSG) 35 together with other elements such as Visitor Location 
Registers 52 and Home Location Register 52. 

5 When the mobile entity 40 is used to make a normal telephone call, a traffic circuit for 
r^-^r^A^^i^iiifiPA voice is set up throughJhe relevant BSS 3 1 to the NSS 32 which is then 
responsible for routing the call to the target phone whether in the same PLMN or in 
another network such as PSTN (Public Switched Telephone Network) 56. 

10 With respect to data transmission to/from the mobile entity 40, in the present example 
three different data-capable bearer services are depicted though other possibilities exist. A 
first data-capable bearer service is available in the form of a Circuit Switched Data (CSD) 
service; in this case a full traffic circuit is used for cairying data and the MSG 35 routes the 
circuit to an InterWorking Function IWF 54 the precise nature of which depends on what is 

15 connected to the other side of the IWF. Thus, IWF could be configured to provide direct 
access to the public Intemet 60 (that is, provide functionality similar to an lAP - Internet 
. Access Provider L\P). Alternatively, the IWF could simply be a modem connecting to 
PSTN 56; in this case, Intemet access can be achieved by coimection across the PSTN to a 
standard LAP. 

20 

A second, low bandwidth, data-capable bearer service is available through use of the Short 
Message Service that passes data carried in signalling channel slots to an SMS unit 53 
which can be arranged to provide connectivity to the public Intemet 60. 

25 A third data-capable bearer service is provided in the form of GPRS (General Packet Radio 
Service which enables IP (or X.25) packet data to be passed from the data handling system 
of the mobile entity 40, via the data interface 44, radio subsystem 41 and relevant BSS 31 , 
to a GPRS network 37 of the PLMN 30 (and vice versa). The GPRS network 37 includes a 
SGSN (Serving GPRS Support Node) 38 interfacing BSC 34 with the network 37, and a 

30 GGSN (Gateway GPRS Support Node) interfacing the network 37 with an external 
network (in this example, the pubHc Intemet 60). Full details of GPRS can be found in the 




ETSI (European Telecommunications Standards Institute) GSM 03.60 specification. Using 
GPRS, the mobile entity 40 can exchange packet data via the BSS 3 1 and GPRS network 
37 with entities connected to the public Internet 60. 

5 The data connection between the PLMN 30 and the Internet 60 will generally be through a 
gateway 55 providing fimctionaUty such as firewall and proxy fimctionality. 

Different data-capable bearer services to those described above may be provided, the 
described services being simply examples of what is possible. Indeed, whilst the above 
10 description of the cormectivity of a mobile entity to resources connected to the 
communications infrastructure, has been given with reference to a PLMN based on GSM 
technology, it will be appreciated that many other cellular radio technologies exist (for 
example, UTMS, CDMA etc.) and can typically provide equivalent fimctionality to that 
described for the GSM PLMN 30. 

15 

The mobile entity 40tself may take many different forms. For example, it could be two 
separate units such as a mobile phone (providing elements 42-44) and a mobile PC 
(providing the data-handUng system 45), coupled by an appropriate link (wireline, infirared 
or even short range radio system such as Bluetooth). Alternatively, mobile entity 40 could 
20 be a single unit. 

Figure 6 depicts both a voice page server 4 connected to the public intemet 60 and a voice- 
based service system 61 accessible via the normal telephone links. 

25 The voice-based service system 61 is, for example, a call center and would typically be 
connected to the PSTN 56 and be accessible to mobile entity 40 via PLMN 30 and PSTN 
56. The system 56 could also (or alternatively) be coimected directly to the PLMN though 
this is unlikely. The voice-based service system 61 includes interactive voice response 
units implemented using voice pages interpreted by a voice browser 3 A. Thus a user can 

30 user mobile entity 40 to talk to the service system 6 lover the voice circuits of the 
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telephone infrastructure; this arrangement corresponds to the situation illustrated in Figure 
4 where the voice browser is co-located with the voice page server. 



If, as shown, the service system 61 is also coimected to the public intemet 60 and is 
5 enabled to receive VoIP (V oice over DP) telephone traffic, then provided the data handling 
ffuh.syfftPm 4^ o£the mQb i k-entily-4Q-ba.s VnTP . fimctionaUty, ther-tfser could u s e a data 
capable bearer service of the PLMN 30 of sufficient bandwidth and QoS (quaUty of 
service) to establish a VoIP call, via PLMN 30, gateway 55, and intemet 60, with the 
service system 61, 

10 

With regard to access to the voice services embodied in the voice pages held by voice page 
server 4 connected to the pubUc intemet 60, if the data-handling subsystem of the mobile 
entity is equipped with a voice browser 3E, then all that the mobile entity need do to use 
these services is to establish a data-capable bearer coimection with the voice page server 4 
1 5 via the PLMN 30, gateway 55 and intemet 60, this connection then being used to carry the 
text based request response messages between the server 61 and mobile entity 4. This 
corresponds to the arrangement depicted in Figure 3. 

PSTN 56 can be provisioned with a voice browser 3B at intemet gateway 57 access point. 

20 This enables the mobile entity to place a voice call to a number that routes the call to the 
voice browser and then has the latter coimect to the voice page server 4 to retrieve 
particular voice pages. Voice browser then interprets these pages back to the mobile entity 
over the voice circuits of the telephone network. In a similar manner, PLMN 30 could also 
be provided with a voice browser at its intemet gateway 55. Again, third party service 

25 providers could provide voice browser services 3D accessible over the public telephone 
network and connected to the intemet to connect with server 4. All these arrangements are 
embodiments of the situation depicted in Figure 5 where the voice browser is located in the 
communication network infirastmcture between the user end system and voice page server. 

30 It will be appreciated that whilst the foregoing description given with respect o Figure 6 
concerns the use of voice browsers in a cellular mobile network environment, voice 
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browsers are equally applicable to other environments with mobile or static connectivity to 
the user. 

Voice-based services are highly attractive because of their ease of use; however, they do 
5 require significant functionaUty to support them. For this reason, whilst it is desirable to 
provide voice interaction capability for many types of devices in every day use, the cost of 
doing so is currently prohibitive. 

It is an object of the present invention to provide a method and apparatus by which entities 
10 can be given a voice interface simply and at low cost. 



Summary of the Invention 

According to one aspect of the present invention, there is provided a method of voice 
1 5 communication concerning a local entity wherein: 

(a) - upon a user approaching the local entity, contact data, identifying a voice service 

associated with the entity but separately hosted, is presented to the user ; 

(b) - thecontactdatais used by equipment carriedbytheusertocontactthevoiceservice 

over a wireless network; 
20 (c) - the user interacts with the voice service with the latter acting as voice proxy for the 

local entity. 

The present invention also encompasses apparatus for implementing the foregoing method. 

25 

Brief Description of the Drawings 

A method and apparatus embodying the invention, for communicating with a dumb entity, 
will now be described, by way of non-lhniting example, with reference to the 
accompanying diagrammatic drawings, in which: 
30 . Figure 1 is a diagram iUustrating the role of a voice browser; 



. Figure 2 
. Figure 3 
5 . Figure 4 



. Figure 5 

10 .Figure 6 

- Figure 7 
15 . Figure 8 
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is a diagram showing the functional elements of a voice browser and their 
relationship to different types of voice markup tags; 
is a diagram showing a voice service implemented with voice browser 
functionality located in an end-user system; 

is a diagram showing a voice service implemented with voice browser 
fimfitionality r.n-1ncatgd with a voice poge-oerverr 



is a diagram showing a voice service implemented with voice browser 
functionality located in a network between the end-user system and voice 
page server; 

is a diagram of a mobile entity accessing voice services via various routes 
through a communications infrastructure including a PLMN, PSTN and 
public internet; 

is a diagram of a first embodiment of the invention involving a mobile 
phone for accessing a remote voice page server; and 
is a diagram of a second embodiment of the invention involving a home 
server system. 



Best Mode of Carrying Out the Invention 

20 In the following description, voice services are described based on voice page servers 
serving pages with embedded voice markup tags to voice browsers. Unless otherwise 
indicated, the foregoing description of voice browsers, and their possible locations and 
access methods is to be taken as applying also to the described embodiments of the 
invention. Furthermore, although voice-browser based forms of voice services are 

25 preferred, the present invention in its widest conception, is not limited to these forms of 
voice service system and other suitable systems will be apparent to persons skilled in the 
art. 
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In both embodiments of the invention to be described below with references to Figures 7 
and 8 respectively, a dumb entity (here a plant 71, but potentiaUy any object, including a 
mobile object) is given a voice dialog capability by associating with the plant 71 a beacon 




device 72 that sends out contact data (either periodically or when it detects persons close 
by) using a short-range wireless communication system such as an infrared system or a 
radio-based system (for example, a Bluetooth system), or a sound-based system. The 
contact data enables suitably-equipped persons nearby to contact a voice service associated 
5 with the plant - the voice service thus acts as a voice dialog proxy for the plant and gives 
the impression to the persons using the service that they are conversing with the plant. 

Considering the Figure 7 embodiment first in more detail, a user 5 is equipped with a 
mobile entity 40 similar to that of Figure 6 but provided with a * sniffer' 73 for picking up 

10 contact data transmitted by the beacon device 72 (see arrow 75). The contact data is then 
used by the mobile entity 40 to contact a voice service provided by a voice page server 4 
that is connected to the public internet and accessible from mobile entity 40 across the 
commvmication infrastructure formed by PLMN 30, PSTN 56 and internet 60. As already 
described with reference to Figure 6, a number of possible routes exist through the 

15 infrastructure between the mobile entity and voice page server 4 and three ways of using 
these routes will now be outlined, it being assmxied that the voice browser used for 
interpreting the voice pages served by server 4 is located in the communications 
infrastructure. 



20 A) - The contact data is a URL specific to the voice service for the plant 7 1 . This URL is 
received by sniffer 73 and passed to an application running in the data handling 
subsystem 45 which passes the URL and telephone number of the mobile entity 40 to 
the voice browser 3 over a data-capable bearer connection set up through the 
communication infrastructure from the mobile entity 40 to the voice browser 3. This 

25 results in the voice browser 3 calling back the mobile entity 40 to set up a voice 

circuit between them and, at the same time, the browser accesses the voice page 
server 4 to retrieve a first page of the voice service associated with the plant 7 1 . This 
page (and any subsequent pages) are then interpreted by the voice browser with voice 
output being passed over the voice circuit to the phone subsystem 43 and thus to user 

30 5, and voice input from the user being retumed over the same circuit to the browser. 

This is the arrangement depicted by the arrows 77 to 79 in Figure 7 with arrow 77 
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representing the initial contact passing the voice service URL and mobile entity 
number to the voice browser, arrow 78 depicting the exchange of request/response 
messages between the browser 3 and server 4, and arrow 79 representing the 
exchange of voice messages across the voice circuit between the voice browser 3 and 
phone subsystem of mobile entity 40. A variant of this arrangement is for the mobile 

entity to initially rontart th^ ynj^.^ pf^gf> SfTVfr dirfHtlyj th^ ^^^^^ ^^^^ ^^^'^g 

responsible for contacting the voice browser and having the latter set up a voice 
circuit to the mobile entity. 

B) - The contact data is a URL specific to the voice service for the plant 71 . This URL is 

received by sniffer 73 and passed to an apphcation running in the data handling 
subsystem 45 which passes the URL to the voice browser 3 over a data capable 
bearer connection estabUshed through the communication infi-astructure from the 
mobile entity 40 to the voice browser 3. The browser accesses the voice page server 
4 to retrieve a first page of the voice service associated with the plant 71 . This page 
(and any subsequent pages) are then interpreted by the voice browser with voice 
output being passed as VoIP data to the data-handling subsystem of the mobile entity 
40 using the same data-capable bearer coimection as used to pass the voice-service 
URL to the browser 3. Voice input fi-om the user is retumed over the same bearer 
connection to the browser. 

C) - The contact data is a telephone number specific to the voice service for the plant 71 . 

This telephone number is received by sniffer 73 and passed to an application running 
in the data handhng subsystem 45 which causes the phone subsystem to dial the 
number. This results in a voice circuit being set up to the voice browser 3 with the 
browser then accessing the voice page server 4 to retrieve a first page of the voice 
service associated with the plant 71 . This page (and any subsequent pages) are then 
interpreted by the voice browser with voice output being passed over the voice circuit 
to the phone subsystem 43 and thus to user 5, and voice input from the user being 
retumed over the same circuit to the browser. 




Where the mobile entity 40 is itself equipped with a voice browser 3 then, of course, 
initial (and subsequent) voice pages can be fetched from the voice page server 4 over a 
data-capable bearer connection set up through the communications infrastructure. In this 
case, where resources (sue as memory or processing power) at the mobile entity are 
5 restricted, the same coimection can be used by the voice browser to access remote 
resources as may be needed, including the pulling in of appropriate lexicons and grammar 
specifications. 

Since the Figure 7 arrangement uses infrastructure resoiurces that are generally only 
1 0 available at a cost to the user, the data handling subsystem can be arranged to prompt the 
user for approval via a user interface of the mobile entity 40 before contacting a voice 
service. 

The nature of the voice service and, in particular the dialog followed, will of course, 
1 5 depend on the nature of the dumb entity being given a voice capability. In the present case 
of a plant 71, the dialog may be directed at informing the user about the plant and its 
general needs. In fact, by associating sensors with the plant that feed information to the 
beacon device 72, the current state and needs of the plant can be passed to the voice service 
- for example, as name- value pairs included in a query string associated with the URL in 
20 (A) and (B) above. The information about the current state and needs of the plant are stored 
by the voice service (for example, as session data either at the voice browser or voice page 
server) and enables the voice service to be conditioned to the state and needs of the plant. 



25 The Figure 8 embodiment concems a restricted environment (here taken to be a home 
environment but potentially any other proprietary space, or office or similar) where a home 
server system 80 includes a voice page server 4 and associated voice browser 3, the latter 
being connected to a wireless interface 82 to enable it to communicate with devices in the 
home over a home wireless network. In this embodiment, the contact data output by the 

30 beacon device 72 associated with plant 71 (see arrow 85) is a URL of the relevant voice 
service page on server 4. This URL is picked up by a URL sniffer 83 carried by user 5 and 
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the URL is relayed over the home wireless network to the home service system and, in 
particular to the voice browser 3 (see arrow 86). This results in the browser 3 accessing the 
voice page server 4 to retrieve a first page of the voice service associated with the plant 71 . 
This page (and any subsequent pages) are then interpreted by the voice browser with voice 
5 output being passed over the home vmeless network to a wireless headset 90 of the user 
(ooo qrrnw. RQ); wr^in^ input from thc ns^r ^ is re tiinredjayetLthg^a^^^^ network to the 
browser. 

As with the Figure 7 embodiment, the voice browser could be incorporated m equipment 
1 0 carried by the user. 

Variants 

Many variants are, of course, possible to the arrangements described above with reference 
to Figures 7 and 8. For example, rather than using a beacon to present the voice-service 
15 contact data to the user, any one or more of the following alternatives can be used: 

machine-readable markings representing the contact data are located on or adjacent 
the entity and are scanned into the user's equipment (a scanner replaces the sniffer of 
the described embodiments); 

a visual, audible or other human-discemable representation of the contact data is 
20 presented to the user with the latter then inputting the contact data in their eqmpment. 

(a user input device replaces the sniffer of the described embodiments). 

In another variant, rather than voice input and output being effected via the user 
equipment (mobile entity for the Figure 7 embodiment, wireless headset 90 for the Figure 
25 8 embodiment), this is done using local loudspeakers and microphones connected by 
wireline or by the wireless network with the voice browser. Alternatively, voice input and 
output can be differently implemented from each other with, for example, voice input 
being done using a microphone carried by the user and voice output done by local 
loudspeakers. 




By having multiple local loudspeakers, and assuming that their locations relative to the 
plant 71 were known to the voice browser system, the voice browser can control the 
volume from each speaker to make it appear as if the sound output was coming from the 
plant. This is particularly usefiil where there are multiple voice-enabled dumb entities in 
5 the same area. A similar effect (making the voice output appear to come from the dumb 
entity) can also be achieved for users wearing stereo-sound headsets provided the 
following information is known to the voice browser (or other element responsible for 
setting output levels between the two stereo channels): 

location of the user relative to the entity (this can be determined in any suitable 
1 0 manner including by using a system such as GPS to accurately position the user, the 

location of the entity being fixed and known); and 

the orientation of the user's head (determined, for example, using a magnetic flux 
compass or solid state gyros incorporated into the headset). 
Knowing the user's position or orientation relative to the entity also enables the voice 

1 5 service to be adapted accordingly. For example, a user approaching the back of an entity 
(typically not a plant) may receive a different voice output from the voice service as 
compared to a user approaching from the front. Similarly, a user facing away from the 
entity may be differently spoken to by the entity as compared to a user facing the entity. 
Also, a user crossing past the entity may be differently spoken to as compared to a user 

20 moving directly towards the entity or a user moving directly away from the entity (that is, 
the voice service is dependent on the user's 'line of approach' -this term here being taken 
to include line of departure also). The user's position/orientation/line-of-approach relative 
to the entity can be used to adapt the voice service either on the basis of the user's initial 
position/orientation/approach to the entity or on an ongoing basis responsive to changes in 

25 the user ' s position/orientation/approach. Information regarding the relative position of the 
user to the entity does not necessarily require the use of user-location determining 
technology or magnetic flux compasses or gyroscopes — the simple provision of multiple 
directional beacon devices can be used to cause the user to pick up different contact data 
depending on their position relative to the entity. Indeed, the beacon devices need not 

30 even be directional if they are each located away from the entity along a respective 
approach route. 
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Where there are multiple voice-enabled dumb entities in the same area, the equipment 
carried by the user or the voice browser is preferably arranged to ignore new contact data 
coming from an entity if the user is still in dialog with another entity (in this respect, end of 
5 a dialog can be determined either as a sufficiently long pause by the user, a specific 
tftiminatinn nrnnmand frojajhejiiser, or a natural end to the voice dialog script). To 
alleviate any problems with receiving contact data from multiple dumb entities that are 
close to each other, the sniffer 73,83 is preferably made highly directional in nature, this 
being readily achieved where the short-range commimication is effected using infrared. 

10 

By arranging for the identity of the user to be passed to the voice browser or voice page 
server when contact is first made with the voice service, profile data on the user (if 
available) can be looked up by a database access and used to customise the service to the 
user. 

15 

Other variants are also possible. For example, the user on contacting the voice service can 
. be joined into a session with any other users currently using the voice service in respect of 
the same entity such that all users at least hear the same voice output of the voice service. 
This can be achieved by fimctionality at the voice page server (session management being 

20 commonly effected at web page servers) but only to the level of what page is currently 
served to each user. It is therefore preferred to implement this common session feature at a 
voice browser thereby ensuring all users hear the same output at the same time. With 
respect to voice input by session members, there will generally be a need for the voice 
service to select one input stream in the case that more than one member speaks at the 

25 same time. The selected input voice stream can be relayed to other members by the voice 
browser to provide an indication as to what input is currently being handled; unselected 
input is not relayed in this manner. 

An extension of this arrangement is to join the user into a session with any other users 
30 currently using the voice service in respect of the same local entity and other entities that 
have been logically associated with that entity, the voice inputs and outputs to and from the 




voice service being made available to all such users. Thus, if two similar plants that are not 
located near each other are logically associated, users in dialog with both plants are joined 
into a common session. 

5 The voice-enabled *dumb* entity can be provided with associated functionality that is 
controlled by control data passed from the voice service via a short-range link between the 
user equipment and beacon device. This control data is for example, scripted into the voice 
pages embedded in multimodal tags for extraction by the voice browser. The control data 
can be passed to the user's equipment from the voice service in a variety of ways 
10 depending in part whether or not the voice browser is located in the user equipment - if it 
is, then the control data is, of course, passed in the voice pages. If the voice browser is 
separate from the user equipment, then the control data can be embedded as audio signals 
in the voice output from the browser or communicated via a separate data chaimel. 

15 Where the *dumb' entity has an associated mouth-like feature movable by associated 
fimctionality, the control data from the voice service can be used to cause operation of the 
mouth-like device in synchronism with voice output from the voice service. Thus a dummy 
can be made to move its mouth in synchronism with dialog it is uttering via its associated 
voice service. This feature, which has application in museums and like attractions, is 

20 preferably used with the aforementioned arrangement of joining users in dialog with the 
same entity into a common session - since the dummy can only move its mouth in 
synchronism with one piece of dialog at a time, having all interested persons in the same 
session and selecting which user voice input is to be responded to, is clearly advantageous. 

25 The mouth-like feature and associated ftmctionaUty can conveniently be associated with 
the dumb entity by incorporation into the beacon device and can exist in isolation from any 
other "living" feature. The mouth-like feature can be either physical in nature with 
actuators controlling movement of physical parts of the feature, or simply an 
electronically-displayed mouth (for example displayed on an LCD display). The 

30 coordination of the mouth- like feature with the voice service output aids people with 
hearing difficulties to understand what is being said. 
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Of course, as well as using multimodal tags for control data to be passed to the entity, more 
normal multimodal interactions (displays, keyboard, pointing devices etc.) can be scripted 
in the voice service provided by the voice page server in the embodiments of Figures 7 and 
8. 
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CLAIMS 



1. A method of voice communication conceming a local entity wherein: 

5 (a) - upon a user approaching the local entity, contact data, identifying a voice service 
associated with the entity but separately hosted, is presented to the user or to 
equipment carried by the user ; 
(b) - the contact data is used by the user's equipment to contact the voice service over a 
wireless network; 

10 (c) - the user interacts with the voice service with the latter acting as voice proxy for the 
local entity. 

2. A method according to claim 1 , wherein the contact data is presented to the user or the 
user 's equipment in at least one of the following ways: 

15 - by means of a beacon device located at or near the local entity and communicating 
with the user's equipment over a short-range communication link; 
by the scanning into the equipment of markings that are located on or adjacent the 
entity and represent the contact data ; 

by being visually or audibly presented to the user with the latter then inputting the 
20 contact data in their equipment. 

3. A method according to claim 1, wherein step (c) involves voice input by the user and 
voice output by the service with both voice input and voice output being carried across the 
wireless network between the voice service and sound input and output devices forming 

25 part of the user's equipment. 

4. A method according to claim 1, wherein step (c) involves voice input by the user and 
voice output by the service with both voice input and voice output being exchanged with 
the user by local sound input and output devices that are associated with the locality of the 

30 entity rather than with the user and are connected with the voice service through a 
communications infrastructure. 
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5. A method according to claim 1, wherein step (c) involves voice input by the user and 
voice output by the service, voice input being carried across the wireless network to the 
voice service from a sound input device forming part of the user's equipment, and voice 

5 output being through at least one local sound output device that is associated with the 
locahty of the entity_iattier_thm3d^ the,jmicej5eDdcfi- 
through a communications infrastructure. 

6. A method according to any one of the preceding claims, wherein sound output is 
1 0 through multiple sound output devices controlled by the voice service so that the sound 

appears to be originating from said local entity. 

7. A method according to claim 1, wherein the voice service is effected by the serving of 
voice pages in the form of text with embedded voice markup tags to a voice browser, the 

15 voice browser interpreting these pages and carrying out speech recognition of user voice 
input, text to speech conversion to generate voice output, and dialog management; the 
voice browser being disposed between a voice page server and the user. 

8. A method according to claim 1, wherein the user equipment includes a mobile phone, 
20 step (b) LQvolving contacting the voice service using the mobile phone and step (c) 

involving the mobile phone to transfer voice service input and output to and from the user. 

9. A method according to claim 1, wherein: 

the voice service is effected by the serving of voice pages in the form of text with 
25 embedded voice markup tags to a voice browser, the voice browser interpreting these 

pages and carrying out speech recognition of user voice input, text to speech 
conversion to generate voice output, and dialog management; the voice browser 
being disposed between a voice page server and the user; and 
the user equipment includes a mobile phone, step (b) involving contacting the voice 
30 service using the mobile phone and step (c) involviug the mobile phone to transfer 

voice service input and output to and from the user. 




10. A method according to claim 9, wherein the voice browser is not part of the user's 
equipment and the contact data comprises a telephone number which when dialled by the 
mobile phone connects over a voice circuit to the voice browser and causes the latter to 

5 access the voice page server, the voice circuit being subsequently used for the exchange of 
voice input and/or output between the user and voice browser. 

11. A method according to claim 9, wherein the voice browser is not part of the user's 
equipment and the contact data is in the form of a URL which in step (b) the mobile phone 

10 passes, via a data-capable bearer service of the mobile-phone wireless network, to the 
voice service; the voice service then using the voice browser to call back the user on the 
mobile phone using a voice circuit that is then used in step (c) for voice input and/or output 
between the user and voice browser. 

15 12. A method according to claim 9, wherein the voice browser is not part of the user's 
equipment and the contact data is in the form of a URL which in step (b) the mobile phone 
passes, via a data-capable bearer service of the mobile-phone wireless network, to the 
voice service; the data-capable bearer service being subsequently used in step (c) for voice 
input and/or output between the user and voice browser using apacketized voice protocol. 

20 

13. A method according to claim 9, wherein the voice browser is part of the user's 
equipment and the contact data is in the form of a URL which in step (b) the voice browser 
uses to access, via a data-capable bearer service of the mobile-phone wireless network, the 
voice page server; the data-capable bearer service being subsequently used in step (c) for 

25 • passing text based input and/or output between the voice browser and voice page server. 

14. A method according to any one of claims 1 to 7, wherein the wireless network is a 
home/office/proprietary-space local network hosting the voice service, the local entity 
being located in the home/office/proprietary-space concerned. 

30 

15. A method according to claim 13, wherein the user equipment includes a wireless 




headset which in step (c) is used for exchanging voice input and output with the voice 



service over the same wireless network as used in step (b). 

16. A method according to claim 1, wherein the carrying out of step (b) is subject to user 
5 approval at the time. 



17. A method according to claim 1, wherein the user equipment ensures that the user is 
only connected to one voice service at a time regardless of how many local entities with 
beacon devices are within pickup range. 

10 

18. A method according to claim 1, wherein in step (b) the identity of the user is sent to 
the voice service and used by the latter to look up user profile data which is then used to 
customise the voice service to the user. 

15 

19. A method according to any one of the preceding claims, wherein the user on 
contacting the voice service in step (b) is joined into a session with any other users 
currently using the voice service in respect of the same local entity such that all users at 
least hear the voice output of the voice service. 

20 

20. A method according to claim 18, wherein voice input firom a user is not broadcast to 
other users joined in the same session unless that input is selected for handling by the voice 
service. 

25 21. A method according to any one of claims 1 to 18, wherein the user on contacting the 
voice service in step (b) is joined into a session with any other users currently using the 
voice service in respect of the same local entity and other entities that have been logically 
associated with that entity, the voice inputs and outputs to and from the voice service being 
made available to all such users. 
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22. A method according to any one of the preceding claims, wherein the beacon device 
includes parameter values relating to the state of said local entity in said contact data, these 
parameter values being passed in step (b) over the wireless network to the voice service 
where they are used in conditioning the output of the voice service. 

5 

23. A method according to any one of the preceding claims, wherein the local entity has 
associated functionality that is controlled by control data passed from the voice service via 
the short-range link between the user equipment and beacon device. 

10 24. A method according to claim 23, wherein the local entity has an associated mouth-like 
feature movable by said functionality, the control data from the voice service being used to 
cause operation of the mouth-like feature in synchronism with voice output from the voice 
service. 

15 25. A method according to claim 24, wherein the mouth-like feature is incorporated into 
the beacon device. 

26. A method according to claim 25, wherein the mouth-like feature is electro-mechanical 
in form with moving mouth parts controlled by electrically-powered actuators. 

20 

27. A method according to claim 25, wherein the mouth-like feature is electronically 
displayed feature. 

28. A method according to claim 1, wherein the voice service provided to a user is 
25 dependent on the user's position, orientation or line of approach relative to the entity. 

29. A method according to claim 28, wherein multiple beacon devices are associated with 
the entity, the contact data of the beacon device first or most recently picked up by the user 
equipment determining the voice service being provided to the user in respect of that 

30 entity. 



24 

30. A method according to claim 28, wherein the location of the user is continually 
monitored and their position relative to the entity is used to determine the voice service 
provided to the user in respect of that entity. 




ABSTRACT 
Voice Communication Concerning a Local Entity 

5 

A local entity (71) without its own means of voice communication is provided with the 
semblance of having a voice interaction capability. This is done by providing a beacon 
device (72) at or near the entity, the beacon device transmitting, over a short-range 
commimication link, contact data identifying a voice service (4) associated with, but hosted 

10 separately from, the entity (71). The transmitted contact data is picked up by equipment 
(73) carried by a nearby person (5) and used to contact the voice service (4) over a wireless 
network (10). The person then interacts with the voice service (4), the latter acting as a 
voice proxy for the local entity (71). The contact data can be presented to the user in other 
ways, for example, by being inscribed on the local entity for scanning or user input into the 

15 equipment. 
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(Fig. 7) 
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